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Abstract 

We  analyze  a  periodically  inspected  system  with  hidden  failures  in  which  the 
rate  of  wear  is  modulated  by  a  continuous-time  Markov  chain  and  additional 
damage  is  induced  by  a  Poisson  shock  process.  We  derive  explicitly  the  system’s 
lifetime  distribution  and  mean  time  to  failure,  as  well  as  the  limiting  average 
availability.  The  main  results  are  illustrated  through  two  numerical  examples. 
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1.  Introduction 

In  this  paper,  we  consider  reliability  and  availability  measures  for  a  single-unit 
system  that  suffers  degradation  due  to  its  operating  environment  and  the  impact  of 
shocks  of  random  magnitude  occurring  at  random  time  intervals.  The  system  is  said 
to  experience  a  soft  failure  when  its  cumulative  level  of  degradation  exceeds  a  fixed 
threshold  value  that  may  be  considered,  for  example,  as  the  component’s  nominal 
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service  life.  However,  it  is  possible  that  failures  remain  hidden  until  a  routine  (planned) 
inspection  of  the  unit  reveals  the  failure.  Using  a  periodic  inspection  policy,  if  the  unit  is 
found  to  have  suffered  an  intolerable  level  of  degradation,  it  is  instantaneously  replaced 
with  a  new  and  identical  unit.  On  the  other  hand,  if  the  level  of  degradation  observed 
upon  inspection  is  acceptable  (i.e. ,  below  the  specified  threshold  value),  no  action  is 
taken  until  the  subsequent  scheduled  inspection.  One  example  of  a  system  maintained 
using  this  type  of  inspection  policy  is  that  of  tool  wear  in  manufacturing  environments. 
Though  the  equipment  may  be  operational,  its  cutting  tool  may  have  suffered  sufficient 
degradation  to  render  it  ineffective  in  achieving  engineering  specifications.  However, 
its  condition  may  not  be  known  until  an  actual  measurement  of  the  accumulated 
degradation  is  obtained.  Hidden  failures  are  also  prevalent  in  the  antennas  of  a  satellite 
tracking  station.  In  such  systems  the  stations,  situated  in  remote  locations  around  the 
globe,  may  be  difficult  to  access  and  inspect.  Hence,  periodic  inspection  policies  are 
needed  to  ensure  proper  communication  links  with  on-orbit  satellites  for  such  critical 
functions  as  surveillance,  communications,  navigation,  and  warning. 

The  impact  of  a  random  environment  on  reliability  and  availability  measures  has 
been  examined  extensively  in  the  applied  probability  literature.  Models  including 
degradation  due  only  to  wear  or  only  to  random  shocks  are  especially  prevalent.  The 
seminal  work  of  Esary,  et  al.  [3]  has  been  extended  in  numerous  directions  by  several 
authors.  For  instance,  Qinlar  [2]  generalized  most  of  the  models  of  [3]  by  demonstrating 
that  the  joint  process  of  the  unit’s  wear  level  and  the  state  of  its  ambient  environment 
may  be  considered  as  a  Markov-additive  process  and  gave  several  such  examples.  The 
first  example  considered  the  case  when  the  random  environment  is  a  general  Markov 
process  with  a  finite  state  space  and  the  wear  was  assumed  to  increase  as  a  Levy 
process.  Additionally,  random  shocks  were  assumed  to  occur  only  at  environment 
transition  epochs.  The  second  example  (see  [2],  pp.  201-202)  is  similar  to  the  problem 
discussed  here  where  the  cumulative  wear  is  a  continuous  additive  functional  of  the 
operating  environment,  and  the  first  time  to  failure  is  a  type  of  first  passage  time 
for  the  degradation  process.  Though  R.ade  [10],  Shanthikumar  and  Sumita  [11],  and 
Nakagawa  [9]  provide  extensions  of  [3]  they  did  not  incorporate  the  effect  of  the  unit’s 
operating  environment  on  reliability  measures.  Igaki  et  al.  [4],  Skoilakis  [12],  and 
Kharoufeh  [5]  present  degradation  models  that  explicitly  incorporate  the  influence  of 
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the  unit’s  operating  environment  but  do  not  consider  the  maintenance  of  such  systems. 

More  recently,  other  researchers  have  placed  an  emphasis  on  studying  maintained 
systems.  For  example,  Klutke  et  al.  [7]  examined  the  availability  of  an  inspected 
system  whose  inter-inspection  times  and  wear  rates  are  random.  Subsequently,  Klutke 
and  Yang  [8]  derived  an  availability  result  for  a  system  subject  to  constant  degradation, 
shocks,  and  a  deterministic  inspection  policy.  In  a  model  similar  to  the  one  presented 
in  [5]  and  in  this  paper,  Kiessler  et  al.  [6]  studied  the  limiting  average  availability  of  a 
system  for  which  the  wear  rate  depends  on  a  continuous-time  Markov  chain  (CTMC) . 
Their  model  considers  an  i.i.cl.  sequence  of  nominal  lifetimes  that  determine  the  failure 
criterion  as  opposed  to  the  deterministic  threshold  value  we  consider.  However,  unlike 
our  model,  [6]  does  not  explicitly  provide  reliability  measures  and  does  not  include  the 
degradation  due  to  random  shocks. 

This  paper  extends  the  results  of  [5]  and  [6]  by  providing  both  reliability  and 
availability  measures  for  a  system  subject  to  Markovian  wear  and  degradation  due 
to  random  shocks.  Additionally,  we  demonstrate  that  the  results  may  be  implemented 
numerically  in  a  straightforward  manner  by  employing  standard  Laplace-transform 
inversion  algorithms.  We  specifically  provide,  in  closed-form,  the  Laplace-Stieltjes 
transform  of  the  unconditional  and  conditional  lifetime  distribution  functions  (d.f.) 
as  well  as  the  unconditional  and  conditional  mean  system  lifetime.  Using  our  main 
results,  and  exploiting  the  Markov-regenerative  nature  of  the  system,  we  compute  the 
limiting  average  availability  of  the  system  under  a  periodic  inspection  policy  using  the 
results  of  [6].  Moreover,  we  illustrate  the  computational  ease  with  which  the  results 
may  be  obtained  numerically  through  two  example  problems. 

The  remainder  of  the  paper  is  organized  as  follows.  In  section  2,  we  provide  the 
formal  mathematical  model  description  and  notation  used  throughout  the  paper.  In 
section  3,  we  analyze  the  model  and  explicitly  derive  the  lifetime  cl.f.s  and  the  mean 
lifetimes  as  Laplace-Stieltjes  transforms.  In  section  4,  we  provide  all  the  components 
needed  to  compute  the  limiting  average  availability  of  the  system  while  section  5 
provides  two  illustrative  numerical  examples. 
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2.  Mathematical  Model 

In  this  section,  we  describe  the  mathematical  model  and  notation  for  the  maintained 
system  with  hidden  failures.  A  single- unit  system  is  placed  into  service  at  time  zero 
in  perfect  working  order.  The  system  accumulates  degradation  until  a  deterministic 
degradation  threshold  value  x  is  exceeded,  at  which  time  the  system  is  said  to  be  failed. 
We  denote  the  random  time  to  achieve  the  threshold  by  Tx.  The  degradation  incurred 
by  the  system  is  attributed  to  environment-induced  wear,  as  well  as  shocks  that  occur 
at  random  time  intervals.  The  wear-  and  shock-inducing  mechanisms  are  assumed  to 
behave  independently  of  one  another.  We  further  describe  the  stochastic  evolution 
of  the  system  in  what  follows.  All  random  variables  are  assumed  to  be  defined  on  a 
complete  probability  space  (f/,A,P). 

The  random  environment  is  characterized  by  an  irreducible  continuous-time  Markov 
chain  Z  =  {Zt  :  t  >  0}  on  a  finite  state  space  S  =  {1, 2, . . . ,  /}  with  infinitesimal  gener¬ 
ator  matrix  Q,  transition  probability  functions  i,j  €  S  and  initial  distribution 

(row)  vector  a.  Whenever  Zt  =  i,  the  system  accumulates  wear  at  a  rate  r(z),  r(i)  >  0 
for  i  =  1,2,...,/.  Define  Rz?  =  diag(r(l),  r(2), ...,  ?’(/)),  the  l  x  /  diagonal  matrix 
containing  the  state-dependent  wear  rates.  The  total  accumulated  wear  up  to  time  t, 
denoted  Wt ,  is 

wt  =  [  r(Zu)du.  (1) 

Jo 

The  cumulative  stochastic  process  W  =  {Wt  :  t  >  0},  commonly  known  as  a  state- 
dependent  wear  process,  has  been  studied  extensively  in  the  literature  (cf.  [3],  [2],  [5]) 
independent  of  a  shock- inducing  mechanism. 

In  addition  to  environment-induced  wear,  the  system  is  damaged  by  shocks  occurring 
at  random  time  intervals.  The  damage  caused  by  an  individual  shock  is  assumed  to 
be  relatively  small;  however,  the  cumulative  effect  of  small  shocks  may  be  significant 
as  in  the  case  of  fatigue  deterioration  resulting  from  mechanical  vibrations.  Denote 
by  Nt  the  number  of  shocks  occurring  up  to  time  t.  The  corresponding  counting 
process  {Nt  :  t  >  0}  is  assumed  to  be  a  temporally  homogeneous  Poisson  process  with 
rate  parameter  A.  The  damage  caused  by  the  nth  shock  is  a  (nonnegative)  random 
variable  Yn  and  {Yn}'^L1  is  an  i.i.cl.  sequence  with  non-defective  distribution  function 
Fy{u)  =  P{T  <  y}.  The  total  cumulative  damage  attributed  to  shocks  up  to  time  t  is 
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the  random  variable, 

Nt 

/3t  =  Ey«-  (2) 

n= 0 

Therefore,  the  total  degradation  accrued  by  the  system  up  to  time  t  is  the  sum  of 
degradation  due  to  wear  and  that  due  to  shocks  given  by 

Xt  =  Wt  +  pt,  t>  0.  (3) 

The  monotonicity  of  X  =  {Xt  :  t  >  0}  and  positivity  of  the  degradation  rates, 
r(l),r(2), . . .  ,r(l),  ensure  the  equivalence  of  events  {Xt  <  x}  and  {Tx  >  t}.  Thus,  the 
system’s  random  lifetime  is  given  by 

Tx  =  inf{f  >  0  :  Xt  >  x},  (4) 

or  the  first  time  the  degradation  process  X  crosses  level  x.  Let  G(x,t )  =  P {Tx  <  t} 
denote  the  unconditional  distribution  function  (d.f.)  of  the  unit’s  lifetime  and  let  its 
first  moment  be  denoted  by  K[TX],  Note  that  (4)  implies 

G(x,t)  =  1  —  P{Xt  <  x}. 

In  the  remainder  of  this  paper,  we  shall  adopt  the  following  notation.  We  let  £;[•]  = 
E[-|Z0  =  *]  and  P,  [-]  =  P[jZo  =  *].  Thus,  the  conditional  distribution  of  the  (first) 
lifetime  is  given  by 

Gi(x,t)  =  1  -  P i{Xt  <  x}. 

The  unconditional  (conditional)  mean  (first)  lifetime  shall  be  denoted  by  E[TX]  (E.JTj,]). 
For  the  purpose  of  computing  the  limiting  average  availability  of  the  maintained  system, 
we  obtain  each  of  these  quantities  in  the  form  of  Laplace-Stieltjes  transforms  in  section 

3. 


3.  Lifetime  Distribution  and  Mean  Lifetime 

In  this  section,  we  provide  analytical  expressions  for  the  system’s  lifetime  distribu¬ 
tion  function  and  the  mean  system  lifetime  in  the  form  of  Laplace-Stieltjes  transforms 
(LSTs).  To  that  end,  we  introduce  the  following  definitions  and  notation.  The 
complement  of  the  lifetime  distribution  is 


R(x,t )  =  G(x,t )  =  P{Xt  <  a;}. 


(5) 
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where  (5)  holds  due  to  the  dual  relationship  Tx  =  inf{t  >  0  :  Xt  >  x}.  Define  the  joint 
probability  distribution 


Rij(x,t)  =  P{Xt  <x,Zt  =  j\Z0  =  i},  i,j  £  S, 


(6) 


Our  first  main  result  characterizes  the  joint  distribution  of  the  process  (X,  Z). 

Theorem  1.  The  distribution  function  Rij(x,t),  i,j  €  S  satisfies  the  partial  differ¬ 
ential  equation 


' >l!  "ift'  ~  +  — ~  r(i)  =  A  t)  *  FY]  (x)  -  Rij(x,  t)j  +  <lkjRi,k{X > 

k=  1 

(7) 

for  x  >  0,  t  >  0  where  (*)  denotes  the  convolution  operator. 


Proof.  We  begin  by  considering  only  the  environment-induced  wear  of  the  system 
and  subsequently  incorporate  shocks.  To  that  end,  set  Vij(x,t)  =  P {Wt  <  x.Zt  = 
j\Z0  =  i}  and  let  e  >  0  denote  a  small  time  increment.  Because  Z  possesses  the 
Markov  property,  is  temporally  homogeneous,  and  is  independent  of  the  degradation 
process  T,  we  may  write  (see  [5]) 

i 

Vij(x,t  +  e)  =  {Wt+e  <  x,Zt+e  =  j\Zt  =  k,Z0  =  i}F{Zt  =  k} 

k= 1 
i 

=  J^P {Zt+e  =j\Zt  =  k}F{Wt+e  <  x,Zt  =  k\Z0  =  i} 

k= 1 
l 

=  k,j(e)Vi,k(x  -  r(k)e,t).  (8) 

k=l 

Next  we  incorporate  the  impact  of  Poisson  shocks  occurring  at  homogeneous  rate 
A.  The  probability  mass  function  (p.m.f.)  of  the  number  of  shocks  occurring  up  to 
time  e  is  pn(e)  =  P {Ne  =  n},  n  >  0.  The  magnitude  of  cumulative  damage  caused  by 
n-independent  shocks  is  given  by 

n 

Pn  =  J2Y'-  (9) 

i=l 

Since  shock  magnitudes  form  an  i.ixl.  sequence  with  distribution  function  Fy,  we  note 
that 

P{/3n  <  y}  =  Fln\y), 
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where  Fy1'1  denotes  the  n-fold  convolution  of  FY.  Conditioning  on  the  number  of  shocks 
in  the  interval  (t.  t  +  e)  and  the  magnitude  of  damage  due  to  those  shocks,  equation 
(8)  may  be  replaced  by 

l  00  /*00 

Ri}j(x,t  +  e)  /  nkj(e)Ritk(x  -  r(k)e- y,t)pn(e)F^l\dy).  (10) 

fc=ln=0"'° 

Substituting  the  appropriate  expressions  for  po(e)  and  pi(e)  in  (10)  and  noting  that, 
for  e  small,  P{lVe  =  n}  =  o(e),  n  >  2,  we  may  write 


Rij  (x,  t  +  e)  =  ^  nk,j  (e)  x 
fc= 1 

(^Ri,k(x  —  r(k)e,t)(l  —  Ae)  +  Ae  J  Ritk(x  -  r(k)e  -  y,t)FY(dy)^j  +  o(e).  (11) 
The  transition  probability  functions  for  the  Z  process,  7r,  j  (e),  i,j  G  S,  can  be  written 


as 


7 Tij(e)  =  Sitj  +  eqij  +  o(e) 


(12) 


where  Stj  assumes  the  value  1  when  i  =  j  and  the  value  0  when  i  ^  j.  Substituting 
(12)  into  (11)  and  simplifying  gives 


Rij(x,t  +  e) 


1 

(1  -  A e)Rij(x  -  r(j)e,  t)  +  e(l  -  Ae)  ^  Qk,jRi,k{x  ~  r(fcK  *) 

k— 1 


+  Ae 


R'i  .  j  (x 


r(j)e 


y,t)FY(dy) 


1  roo 

+  Ae2 y; qk,j  j  Ri,k(x  -  r{k)e- y,t)FY(dy)  +  o(e).  (13) 

k  Jo 

Rearranging  and  simplifying  the  terms  of  (13),  dividing  through  by  the  time  increment 
e,  and  allowing  e  — +  0,  shows  that 


dRij(x,t)  dRi  :j(x,  t) 

-or-  +  = 

^  /*oo 

-  A Rjj{x,  t)  +  gk,jRi,k{x7 1)  +  A  /  Ri,j(x  -  y,t)FY{dy)  (14) 

k= 1 

where  the  right-most  term  of  (14)  is  the  convolution  of  distributions  R,tj  and  FY. 


We  next  set  out  to  solve  the  partial  differential  equations  of  (7)  by  the  method  of 
Laplace  transforms.  To  that  end,  define  the  l  x  l  matrix  R(x,  t)  =  [Rij(x,t)\.  Using 
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matrix  notation,  (7)  may  be  written  as 

=  X  *)  *  (*)  -  R(®,  *)}  +  R(*>  *)Q  (15) 

where  [R(-,  t)  *  Fy]  (x)  denotes  the  convolution  of  each  element  of  R(x,  t)  with  Fy.  We 
next  provide  a  Laplace-Stieltjes  transform  (LST)  solution  with  respect  to  the  spatial 
variable  x  for  the  partial  differential  equation  (15).  Define  the  matrix  LST  of  R(x,t) 
with  respect  to  x  as 

/»oo 

R(u,i)=  /  e~uxIi  (dx,t)  (16) 

Jo 

and  the  l  x  l  diagonal  matrix  F y,  (u)  with  each  diagonal  element  identically  equal  to 

/»oo 

Fy(u)  =  /  e-uyFy(dy),  (17) 

Jo 

the  LST  of  Fy  with  respect  to  y. 


Theorem  2.  The  Laplace-Stieltjes  transform  of  the  matrix  R(x,  f)  with  respect  to  the 
spatial  variable  x  is 


R(w,  t)  =  exp  +  A(F d(u)  —  I)  —  uRjjj  t 


(18) 


Proof.  Taking  the  Laplace-Stieltjes  transform  of  both  sides  of  (15)  with  respect  to 
x  yields  the  first  order,  ordinary  differential  equation  (ODE)  in  t, 

+  R(u,  t)  («Rfl  +  AI  -  Q  AFd(u))  =  0.  (19) 

The  general  solution  of  the  ordinary  differential  equation  is  obtained  via  the  use  of  an 
integrating  factor 


R(w,f)exp  |«Rfl  +  AI  —  Q  —  AFd('u)^  t 


if’. 


where  if  is  a  matrix  of  constants  of  integration.  The  final  result  is  obtained  by  applying 
the  initial  condition  R(u,  0)  =  I  and  rearranging  terms. 


The  initial  probability  vector  of  the  environment  process  Z  is  a  =  [a*]  where  = 
P{Zq  =  i},  i  €  S.  Let  e  denote  a  column  vector  of  ones  and  denote  by  e,  a  column 
vector  whose  itli  element  is  unity  and  all  other  elements  are  zero.  An  explicit  expression 
for  the  unconditional  d.f.  of  the  system’s  lifetime  is 


G(x,  t)  =  P {Tx  <£}  =  !  —  aR(x,  t)e 


(20) 
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and  the  conditional  distribution  is 

Gi( x, t)  =  Pi{Tx  <t}  =  1-eJ R(x, t)e  (21) 

where  ej  denotes  the  transpose  of  e^. 

Define  the  Laplace-Stieltjes  transforms  of  G(x,t)  and  Gi(x,t)  with  respect  to  x  as 


G(u,t)=  /  e~uxG(dx,  t) 

Jo 


Gi(u,t)  =  /  e-uxGi(dx,t), 
Jo 


respectively. 


Theorem  3.  The  Laplace-Stieltjes  transform  of  the  unconditional  and  conditional  first 
lifetime  distributions,  G(x,t)  and  Gi(x,t ),  with  respect  to  x  are,  respectively, 

G(u,t)  =  1  —  ctexp  f(Q  +  X(Fd(u)  —  I)  —  uRjjjt)  e  (24) 


Gi(u,t)  =  l- ef  expy(Q  + \(Fd(u) -I)  -  uJHD)t)  e,  (25) 

with  Re(u)  >  0. 

Next  we  examine  the  unconditional  (conditional)  mean  system  lifetime,  E[TX]  (E.^T,,]) 
for  a  single-unit  system  subject  to  Markovian  wear  and  a  Poisson  shock  process.  The 
LSTs  of  E[Ta;]  and  E;[Xj;],  with  respect  to  x,  are  respectively, 

/»oo 

E[T„]  =  /  e~uxdxE[Tx} 

Jo 


Ei[ru]=  /  e-uxdxEt[Tx\, 

Jo 

which  are  obtained  via  Theorem  4. 

Theorem  4.  The  Laplace-Stieltjes  transform  of  the  unconditional  mean  lifetime  with 


respect  to  x  is 


E[TU]  =  a  ^wRj)  -  Q  A(F D(u)  -  1)^) 
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and  the  conditional  mean  lifetime  is 

E i[Tu\  =  ef  (uRd  -  Q  -  A(FD(u)  -  I))"'  e,  (27) 

with  Re(u )  >  0. 

Proof.  By  (24),  the  d.f.  of  the  system  lifetime  is 

G(u,  t)  =  1  —  a  exp  +  A(F£>(u)  —  I)  —  wRdJ  t  e. 

For  brevity,  substitute  A  =  Q  +  A(F d(u)  —  I)  —  uRjj  to  obtain  the  LST  of  G(u,  t )  with 
respect  to  t  as 

/»oo 

G(u,s )  =  /  e~stG(u,dt) 

Jo 

=  1  —  aA(sI  —  A)_1e.  (28) 

In  the  usual  way,  the  mean  system  lifetime  is  obtained  by  evaluating  at  s  =  0  the  first 
partial  derivative  of  G(u ,  s)  with  respect  to  s.  That  is 

dG(u,  s) 

9s 

5=0 

=  —  a(— A)-1e 

=  a(iiRD  —  Q  —  X(Fd(u)  -  I))_1e. 

The  conditional  mean  lifetime  is  obtained  analogously  by  simply  replacing  G(u,  t)  by 
Gi(u,t). 

4.  Limiting  Average  Availability 

In  this  section,  we  study  the  asymptotic  behavior  of  the  average  availability  of 
the  maintained  system  with  hidden  failures.  The  main  result  for  the  limiting  average 
availability  (Theorem  5)  is  contained  in  Kiessler  et  al.  [6];  however,  we  review  this  result 
within  the  framework  of  our  model  which  differs  from  that  of  [6]  in  a  few  important 
ways.  In  our  model,  a  failure  occurs  when  the  cumulative  degradation  (due  to  wear 
and  shocks)  reaches  or  exceeds  a  deterministic  threshold.  The  model  in  [6]  does  not 
consider  shocks.  Moreover,  the  numerical  approach  we  use  for  computing  the  limiting 
average  availability  is  significantly  simpler.  Specifically,  we  apply  the  Laplace-Stieltjes 


E[TU] 
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transforms  of  section  3  and  numerical  inversion  to  simplify  the  computation  of  the 
required  components. 

The  system  is  inspected  periodically  at  times  in  the  set  I  =  {kr  :  k  =  1,2, . . .}  for 
some  r  >  0.  If  upon  inspection  the  system  is  found  to  be  failed  (i.e.,  the  cumulative 
degradation  of  the  system  is  at  least  as  large  as  the  tolerable  level  a;),  then  it  is 
instantaneously  replaced  with  a  new  and  identical  unit;  however,  if  the  system  is  found 
to  be  non-failed,  then  no  action  is  taken.  Failures  occurring  between  inspection  epochs 
cannot  be  detected  nor  repaired;  thus,  failures  remain  hidden  until  the  next  inspection 
epoch,  and  the  process  X  remains  at  the  failed  level  until  the  subsequent  inspection 
epoch.  We  further  assume  that  inspections  correctly  diagnose  the  level  of  degradation. 
Define  T  =  :  t  >  0},  the  right-continuous  stochastic  process  describing  the 

system  state  by 

4>{t)  =  l(Xt  <x), 


where  1(E)  denotes  the  indicator  function  for  event  E.  As  defined  in  [6],  the  system’s 
limiting  average  availability  is  given  by 

rt 


A  =  lim  t  1  /  F,[ip(w)]dw.  (29) 

t— >°°  Jo 

Let  Ln  denote  the  lifetime  of  the  nth  system  and  let  Rn  denote  the  nth  replacement 
epoch  (with  R0  =  0) .  We  further  define  =  Znn ,  the  state  of  the  environment  at  the 
time  of  the  ?rth  replacement,  and  Fn,  the  nth  failure  epoch.  The  process  {£„  :  n  >  0}  is 
an  irreducible  discrete-time  Markov  chain  with  one-step  transition  probability  matrix 
P  and  stationary  distribution  p  =  [p,;],  *  =  1,2,...,/.  It  is  important  to  note  that,  by 
its  nature,  T  =  {ip(t)  :  t  >  0}  is  not  regenerative  with  respect  to  the  sequence  of  failure 
or  replacement  epochs.  This  is  due  to  the  fact  that  successive  unit  lifetimes  do  not 
form  an  i.i.d.  sequence  of  random  variables  unless  the  successive  units  are  placed  into 
service  in  identical  environment  states.  Kiessler,  et  al.  [6]  showed  that  the  bivariate 
process,  {(£„,!?„)  :  n  >  0},  is  a  Markov  renewal  process  and  that  {ip(t)  :  t  >  0}  is 
Markov-regenerative  with  respect  to  {(£„,  Rn)  :  n  >  0}.  Consequently,  the  limiting 
average  availability  is  obtained  by  Theorem  5  (see  [6],  p.  704). 


Theorem  5. 


The  limiting  average  availability  is  given  by 


A  =  lim  t 

t- 


-l 


E  [ip(w)]dw  = 


'Li=iPiEi[Fi\ 

Ei=l  Vi^i[R l] 


0 


(30) 
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In  order  to  compute  the  limiting  average  availability,  we  will  obtain  the  transition 
probability  matrix  P  as  the  limit  of  the  semi-Markov  kernel  of  the  process  {(£„,  Rn)  : 
n  >  0}.  Subsequently,  we  obtain  the  stationary  distribution  p.  Additionally,  we 
require  the  conditional  expectations  E,  [E,-t  ]  and  E,:  [fq  ] .  Fortunately,  the  Laplace- 
Stieltjes  transform  of  E;[-Fi]  may  be  obtained  by  (27),  and  the  conditional  distribution 
of  F\  is  given  by  (25).  Thus,  our  next  objective  is  to  provide  an  expression  for 
However,  we  first  need  to  establish  that  F\  is  a  bounded  random  variable.  Let  us 
re-order  the  wear  rates  so  that 


rq  <  r2  <  ■  ■  ■  <  n. 

That  is,  rq  corresponds  to  the  minimum  attainable  wear  rate.  The  following  lemma 
holds  for  both  the  conditional  and  unconditional  first  unit  lifetimes. 

Lemma  1.  The  random  variable  F\  is  bounded  above  by  xrf1 . 

Proof.  Let  D  =  {r(i)  :  i  =  1, 2, . . . ,  1}  and  let  r  =  (rq,  r%, . . . ,  n)T  denote  the  column 
vector  of  ordered  wear  rates.  Further  define  the  set 

A  =  {a  G  :  ae  =  xrf1}. 

We  first  note  that 

infjar  +  b  :  a  £  A,b  >  0}  <  x  (31) 

since  for  a  =  xrfxe \  and  b  =  0,  ar  +  b  =  x.  Moreover, 

infjar  +  fo  :  a  €  A,  6  >  0}  =  infjar  :  a  £  A} 

>  inf{a(?qe)  :  a  £  A} 

=  x.  (32) 

By  (31)  and  (32)  we  see  that 

x  =  minjar  +  b  :  a  £  A,  b  >  0}.  (33) 

Let  to  £  and  define  the  quantity 

rx/ri 

wn(w)  =  /  1  (r(Zt(u>))  =  rn)dt. 

Jo 
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Summing  over  all  possible  environment  states,  we  see  that 

l  l  „ x/n 


-  •_  px/r  i 

/  1  (r(Zt(u>))  =  rn)dt. 

n= 1  n—1 

=  [  Y'  l(r(Zt(w))  =  rn)df 

Jo  _ _ , 


In 

l(r(Zt(oj))  £  D)dt 

/ri 

dt 

=  xr±x, 

since  r(Zt(u;))  £  D  for  almost  every  t.  >  0.  It  follows  that  the  row  vector  w(w)  = 
(wi(w),...,t/;j(u;))  G  A 

Recall  that  the  total  damage  due  to  shocks  on  the  interval  [0,x/ri)  is  given  by 
fix/ri  (<-t0  •  Using  equation  (3),  we  may  write 


Xx/ri  M 


U^c/ri(^)  “1“  Px/rii.^') 


—  T'n ))dt  +  /3X/Vl  (lt>) 

=  rf'n)')dt  +  Ar/ri^) 


=  X!  +  ^x/ri  M 

n—1 

=  w(w)r  +  f3x/ri(uj). 

By  (33)  we  may  conclude  that 

x  =  min {Xx/ri(oS)  :  u  £  fl}. 

Since  Xx/ri  (w)  >  x,  it  is  clear  that 

|Fi(a;)|  =  Fi(u)  =  inf{f  >  0  :  Xt(u>)  >  x}  <  xrf1, 
i.e.,  the  non-negative  random  variable  F\  is  bounded  above  by  xrf1. 
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Lemma  1  implies  that  Gi(x ,  i)  =  1  for  all  t  >  xrf  Equipped  with  this  result,  we  are 
now  prepared  to  establish  the  mean  of  the  first  replacement  epoch  and,  subsequently, 
the  limiting  average  availability. 


Lemma  2.  The  conditional  expectation  of  the  first  replacement  epoch  is  given  by 


=  r  f  j  -  y  Gi^nr)^ 

\  n—0  ) 


(34) 


where  7  =  min{?r  >  1  :  nr  >  xrx  }  and  rq  =  min{r(i)  :  i  =  1, 2, . . . ,  /}. 
Proof.  The  first  replacement  time  R\  depends  explicitly  on  F\  by 


Ri  =  inf{ru  G  /  :  w  >  Fi}. 


By  construction,  Fi  corresponds  to  the  lifetime  of  the  first  unit,  and  as  such,  has  the 
(conditional)  distribution  function  Gi(x,t),  i  G  S.  By  conditioning  on  F[ ,  we  obtain 


E,:[-Ri|Li 


t]Gi(x,  dt). 


(35) 


Jo 

Because  a  failure  remains  hidden  until  the  first  inspection  following  the  failure,  the 
integrand  of  (35)  is 


—  t] 


r,  0  <  t  <  T 

2  T,  T  <t  <2t 

nr ,  (n  —  l)r  <  t  <  nr 


(36) 


Substituting  (36)  into  (35),  we  may  write 

/*T  p2t  /»3  T 

Ei[i?i]  =  t  /  Gi(x,dt)  +  2r  /  Gi(x,dt)  +  3r  /  Gi(:r,  dt)H - , 

^0  «  t  «/  2r 

00 

=  — t  Gi(x,nr). 

n—0 


(37) 


By  applying  Lemma  1  it  can  be  shown  that  the  infinite  series,  — Y!n  Gi{x,nT ),  is 
convergent  with  sum 


7-1 


^  —Gi(x,  nr)  =7  -'Y^Gi(x,riT), 


n—0 


n—0 


(38) 
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where  7  =  min{n  >  1  :  nr  >  xr1  }.  Therefore, 


Ej[i?i]  =  T  (7  -  X!  G'i(a;)nr)N)  • 

V  n=o  / 


(39) 


Finally,  we  turn  our  attention  to  the  transition  probability  matrix,  P ,  for  the 
discrete-time  Markov  chain  {£„  :  n  >  0}.  Before  deriving  an  expression  for  the 
elements  of  P,  we  need  to  establish  the  conditional  distribution  of  R\  given  the  initial 
environment  state. 


Lemma  3.  Assuming  the  initial  environment  state  is  i  £  S,  the  probability  mass 
function  of  Ri  is  given  by 


=  nr}  =  A  i(x,nr),  n>  1 


(40) 


where  Aj(x,  nr)  =  Gi(x,  nr)  —  Gi{x,  ( n  —  l)r)  for  i  £  S  and  n  >  1. 


Proof.  Recall  that  R\  =  inf{u;  £  I  :  w  >  Pi}.  Thus,  we  obtain  the  probability 
distribution  of  R\  by  conditioning  on  the  first  failure  epoch  given  the  initial  state  of 
Z.  For  n  >  1, 


/♦OO 

i{Ri  =  nr}  =  /  P;{i?i  =  nr\Fi  =  t}Gi(x ,  dt) 

Jo 

pOO 

=  /  1(£  G  [(n  —  l)r,  nr])Gi(x,  dt) 

Jo 

nTlT 

=  /  Gi(x,  dt) 

J  (n— l)r 

=  Gi{x,nr)  —  Gi(x,  (n  —  l)r). 


Finally,  we  obtain  the  one-step  transition  probability  matrix  for  {£n  :  n  >  0}  by 
computing  the  limit  of  the  semi-Markov  kernel  matrix  of  the  Markov  renewal  process 
{(fn,Rn)  ■  n  >  0}. 

Theorem  6.  The  (*,  k)th  element  of  the  transition  probability  matrix  P  =  [pi,k\,  i,k  £ 
S,  is  given  by 

7 

Pi,k  =  ^2  7r*,fc(n'r)A*(a:>  nr),  (41) 

n= 1 

where  Ai(x,nr)  is  obtained  by 

A i{x,nr)  =  T_1{u_1[Gj(n,nr)  -  G*(u,  (n  -  l)r)]},  (42) 
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C  1  denotes  the  inverse  Laplace  transform  operator,  and  the  integer  7  is  as  defined  in 
Lemma  2. 

Proof.  Let  Ki)k(t)  =  P{£i  =  k,  R\  <  <|£o  =  *}  denote  the  (i,k) th  element  of  the 
semi-Markov  kernel,  K(f),  of  the  Markov  renewal  process  {(£„,i?„)  :  n  >  0}.  Let  us 
further  define 

Kitk(8)  =  E,;[e-Sfll  •  1  {ZRl  =  k)] 


with  Re(s)  >  0.  By  conditioning  on  R\,  we  may  write, 

OO 

Et[e~sRl  ■  1  (ZRl  =  k)}  =  Y,  •  1  (ZRl  =  k)  \R±  =  nr] P^i  =  nr} 

n= 1 
00 

=  Y  e~snTEdl(Znr  =  k)]Ai(x,nr) 

n= 1 
00 

=  Y  e~snTPi{ZnT  =  k}Ai(x,  nr) 

n— 1 

00 

=  Ye~SnT7rrk(nT)Ai(x,nT).  (43) 

n—1 

By  the  final  value  theorem  of  Laplace  transforms,  we  may  obtain  pik  as 


Pi,k  =  lim  Kik(t) 

t—>  OO 

=  lim  Ki  As) 

s — >-0 

00 

=  lim  V  e~snTTTi  k(nT)Ai(x,  nr). 

s—*D  z — ' 
n=l 

Recall  from  Lemma  1  that  At(x,  nr)  =  0  for  all  n  >  7  +  1,  and  so  we  have 

OO 

pi  k  =  lim  Y'  e~snT'xi  k(nr )Ai(x,  nr ) 

s— K)  z — ' 
n—1 

7 

=  lim  7  e~snTTTik{nT)Ai(x,nT) 

s—*  0  ^ ' 
n—1 

7 

=  ’Y,  lim  e_s"T7rj)fc(nr)Aj(x,  nr) 

n= 1 
7 

=  Ynrk{nT)Al(x,nT). 

n—1 

Comparing  equation  (41)  with  Corollary  1  of  [6],  p.  708,  we  note  that  our  expression 
requires  the  evaluation  of  only  a  finite  sum  and  (numerical)  Laplace  transform  inversion 
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to  obtain  A i(x,nr),  Et  [P|  ] ,  and  Fortunately,  numerical  inversion  algorithms 

abound  for  this  task,  and  the  truncation  point  7  is  well  defined  by  the  parameters  r 
and  r-| .  By  contrast,  the  results  of  [6]  require  evaluation  of  an  infinite  Fourier  series  to 
compute  Pi  k  and  the  conditional  expectations. 


5.  Numerical  Examples 

In  this  section,  we  illustrate  the  computation  of  the  limiting  average  availability  by 
means  of  two  examples.  For  both  examples,  we  compute  the  conditional  expectations, 
Ej[Fi]  and  Ej[i?i],  the  matrix  P,  the  stationary  distribution  p,  and  the  limiting  average 
availability,  A.  The  results  were  obtained  via  numerical  Laplace-transform  inversion 
using  the  robust  technique  of  Abate  and  Whitt  [1].  The  algorithm  was  coded  and 
executed  in  the  Matlab®  computing  environment.  In  each  of  the  two  cases,  Z  is  an 
irreducible  continuous-time  Markov  chain  on  finite  state  space  S  with  generator  matrix 

Q 

Example  1:  l  =  2 

The  first  case  is  a  simple  environment  which  toggles  between  two  distinct  states 
( S  =  {1,  2})  according  to  its  generator  matrix 

—25/3  25/3 

25/3  -25/3 

The  diagonal  matrix  of  state-dependent  wear  rates  is 

Kd  =  diag  (13/12, 1/4) , 


while  the  Laplace-Stieltjes  transform  of  the  shock-magnitude  distribution  function  is 


Fy(u ) 


4.0 

4.0  +  u' 


Shocks  occur  according  to  a  Poisson  process  with  rate  parameter  A  =  0.50.  The 
threshold  degradation  level  for  failure  is  x  =  1.0  units  of  degradation.  Inspections 
occur  every  r  =  0.10  time  units.  Applying  equations  (27)  and  (34),  we  compute 


=  1.2976 


Ei  [Pi] 

E2[Pi] 


1.3609 
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and 


Ei[i?i]  =  1.3475 
E2[i?i]  =  1.4109. 


Selecting  the  truncation  point  7  by  Theorem  6,  the  transition  probability  matrix  is 


P 


0.5002  0.4998 
0.4998  0.5002 


with  the  obvious  stationary  distribution 


P=(  0.500  0.500 


Subsequently,  the  limiting  average  availability  is  computed  as 


A  = 


T,i=lPiEilFl] 

EllftW] 


=  0.96378. 


Example  2:  l  —  5 


In  this  case,  the  environment  process  is  a  five-state,  continuous-time  Markov  chain 
with  state  space  S  =  {1,2, 3, 4, 5}.  The  generator  matrix  for  the  process  is 


-0.500 

0.125 

0.125 

0.125 

0.125 

0.400 

-2.00 

0.400 

0.600 

0.600 

0.025 

0.025 

-0.100 

0.025 

0.025 

0.050 

0.050 

0.050 

-0.200 

0.050 

1.500 

1.000 

1.000 

1.500 

-5.000 

The  diagonal  matrix  of  state-dependent  wear  rates  is 


Rd  =  diag  (1.0,  2.0, 3.0, 4.0, 10.0) , 


while  the  Laplace-Stieltjes  transform  of  the  shock-magnitude  distribution  function  is 

8 


Fy(u)  = 


0.20 

0.20+  u 


Shocks  occur  according  to  a  Poisson  process  with  parameter  A  =  0.25.  The  threshold 
degradation  level  for  failure  of  the  system  is  x  =100  units  of  degradation.  Inspections 
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occur  every  r  =  5.00  time  units.  Applying  (41)  gives 


0.1393 

0.0300 

0.4810 

0.3368 

0.0129 

0.1262 

0.0291 

0.4868 

0.3454 

0.0126 

0.1045 

0.0258 

0.6115 

0.2471 

0.0112 

0.1255 

0.0301 

0.4181 

0.4133 

0.0130 

0.1268 

0.0291 

0.4876 

0.3439 

0.0126 

Table  1  summarizes  the  stationary  probabilities  and  the  conditional  expectations  for 
this  case. 


Table  1:  Stationary  probabilities  and  conditional  means  (Ex.  2). 


Measure 

i  =  1 

i  =  2 

i  =  3 

i  =  4 

i  =  5 

Pi 

0.1160 

0.0277 

0.5308 

0.3135 

0.0120 

11.6861 

11.4400 

11.4752 

11.2014 

11.3457 

E<[Pi] 

9.1931 

8.9485 

8.9836 

8.7116 

8.8542 

From  these  values,  we  compute  the  limiting  average  availability 

-v5 


A=  Y,i=iVi^i[Fi] 


=  0.7817. 
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